Bug/sbp cancellation #13474
Merged
Bug/sbp cancellation #13474
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
❌ Gradle check result for aa4fd2b: FAILURE Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change? |
|
❌ Gradle check result for bf11c85: FAILURE Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change? |
|
❌ Gradle check result for 5bcac55: FAILURE Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change? |
kaushalmahi12
requested review from
anasalkouz,
andrross,
Bukhtawar,
CEHENKLE,
dblock,
dbwiddis,
dreamer-89,
gbbafna,
kotwanikunal,
mch2,
msfroh,
nknize,
owaiskazi19,
reta,
Rishikesh1159,
sachinpkale,
saratvemulapalli,
shwetathareja,
sohami,
tlfeng and
VachaShah
as code owners
|
Hi @kaushalmahi12, thank you for submitting this PR. Would you mind also creating a cancellation logic diagram similar to |
jainankitk
reviewed
May 8, 2024
server/src/test/java/org/opensearch/search/backpressure/stats/SearchShardTaskStatsTests.java
Outdated
Show resolved
Hide resolved
server/src/test/java/org/opensearch/search/backpressure/stats/SearchTaskStatsTests.java
Outdated
Show resolved
Hide resolved
server/src/main/java/org/opensearch/search/backpressure/trackers/NodeDuressTrackers.java
Outdated
Show resolved
Hide resolved
server/src/main/java/org/opensearch/search/backpressure/trackers/TaskResourceUsageTrackers.java
Outdated
Show resolved
Hide resolved
server/src/main/java/org/opensearch/search/backpressure/SearchBackpressureService.java
Outdated
Show resolved
Hide resolved
server/src/main/java/org/opensearch/search/backpressure/SearchBackpressureService.java
Outdated
Show resolved
Hide resolved
server/src/main/java/org/opensearch/search/backpressure/SearchBackpressureService.java
Show resolved
Hide resolved
server/src/main/java/org/opensearch/search/backpressure/SearchBackpressureService.java
Outdated
Show resolved
Hide resolved
|
❌ Gradle check result for 6b1c658: FAILURE Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change? |
|
❌ Gradle check result for cd3e65b: FAILURE Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change? |
|
❌ Gradle check result for 2c3c4bc: FAILURE Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change? |
|
❌ Gradle check result for 3c3c64e: FAILURE Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change? |
Signed-off-by: Kaushal Kumar <[email protected]>
kaushalmahi12
force-pushed
the
bug/sbpCancellation
branch
from
3c3c64e to
214feba
Compare
Signed-off-by: Kaushal Kumar <[email protected]>
|
❕ Gradle check result for 214feba: UNSTABLE Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure. |
|
❌ Gradle check result for becc022: FAILURE Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change? |
Signed-off-by: Kaushal Kumar <[email protected]>
Signed-off-by: Kaushal Kumar <[email protected]>
Failure related to |
sohami
approved these changes
Jun 21, 2024
opensearch-trigger-bot bot
pushed a commit
that referenced
this pull request
Jun 21, 2024
* change cancellation logic to fix disparity bw trackers and resource duress Signed-off-by: Kaushal Kumar <[email protected]> * add additional tests for searchBackpressureService and refactor code Signed-off-by: Kaushal Kumar <[email protected]> * add enumMap instead of list for tracking taskResourceUsageTrackets Signed-off-by: Kaushal Kumar <[email protected]> * add nodeNotInDuress test for nodeDuressTrackers class Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * add entry in CHANGELOG Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * remove wildcard import Signed-off-by: Kaushal Kumar <[email protected]> * streamline imports Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * add additional test case to test the circuit breaker for SBP logic Signed-off-by: Kaushal Kumar <[email protected]> * add missing javadoc to resourece type enum Signed-off-by: Kaushal Kumar <[email protected]> * add javadoc to a method Signed-off-by: Kaushal Kumar <[email protected]> * fix javadoc warnings Signed-off-by: Kaushal Kumar <[email protected]> * fix javadoc warnings Signed-off-by: Kaushal Kumar <[email protected]> --------- Signed-off-by: Kaushal Kumar <[email protected]> (cherry picked from commit bcccedb) Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
sohami
pushed a commit
that referenced
this pull request
Jun 24, 2024
* Bug/sbp cancellation (#13474) * change cancellation logic to fix disparity bw trackers and resource duress Signed-off-by: Kaushal Kumar <[email protected]> * add additional tests for searchBackpressureService and refactor code Signed-off-by: Kaushal Kumar <[email protected]> * add enumMap instead of list for tracking taskResourceUsageTrackets Signed-off-by: Kaushal Kumar <[email protected]> * add nodeNotInDuress test for nodeDuressTrackers class Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * add entry in CHANGELOG Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * remove wildcard import Signed-off-by: Kaushal Kumar <[email protected]> * streamline imports Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * add additional test case to test the circuit breaker for SBP logic Signed-off-by: Kaushal Kumar <[email protected]> * add missing javadoc to resourece type enum Signed-off-by: Kaushal Kumar <[email protected]> * add javadoc to a method Signed-off-by: Kaushal Kumar <[email protected]> * fix javadoc warnings Signed-off-by: Kaushal Kumar <[email protected]> * fix javadoc warnings Signed-off-by: Kaushal Kumar <[email protected]> --------- Signed-off-by: Kaushal Kumar <[email protected]> (cherry picked from commit bcccedb) Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * Bug/sbp cancellation (#13474) * change cancellation logic to fix disparity bw trackers and resource duress Signed-off-by: Kaushal Kumar <[email protected]> * add additional tests for searchBackpressureService and refactor code Signed-off-by: Kaushal Kumar <[email protected]> * add enumMap instead of list for tracking taskResourceUsageTrackets Signed-off-by: Kaushal Kumar <[email protected]> * add nodeNotInDuress test for nodeDuressTrackers class Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * add entry in CHANGELOG Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * remove wildcard import Signed-off-by: Kaushal Kumar <[email protected]> * streamline imports Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * add additional test case to test the circuit breaker for SBP logic Signed-off-by: Kaushal Kumar <[email protected]> * add missing javadoc to resourece type enum Signed-off-by: Kaushal Kumar <[email protected]> * add javadoc to a method Signed-off-by: Kaushal Kumar <[email protected]> * fix javadoc warnings Signed-off-by: Kaushal Kumar <[email protected]> * fix javadoc warnings Signed-off-by: Kaushal Kumar <[email protected]> --------- Signed-off-by: Kaushal Kumar <[email protected]> * fix compilation error Signed-off-by: Kaushal Kumar <[email protected]> --------- Signed-off-by: Kaushal Kumar <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
harshavamsi
pushed a commit
to harshavamsi/OpenSearch
that referenced
this pull request
Jul 12, 2024
* change cancellation logic to fix disparity bw trackers and resource duress Signed-off-by: Kaushal Kumar <[email protected]> * add additional tests for searchBackpressureService and refactor code Signed-off-by: Kaushal Kumar <[email protected]> * add enumMap instead of list for tracking taskResourceUsageTrackets Signed-off-by: Kaushal Kumar <[email protected]> * add nodeNotInDuress test for nodeDuressTrackers class Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * add entry in CHANGELOG Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * remove wildcard import Signed-off-by: Kaushal Kumar <[email protected]> * streamline imports Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * add additional test case to test the circuit breaker for SBP logic Signed-off-by: Kaushal Kumar <[email protected]> * add missing javadoc to resourece type enum Signed-off-by: Kaushal Kumar <[email protected]> * add javadoc to a method Signed-off-by: Kaushal Kumar <[email protected]> * fix javadoc warnings Signed-off-by: Kaushal Kumar <[email protected]> * fix javadoc warnings Signed-off-by: Kaushal Kumar <[email protected]> --------- Signed-off-by: Kaushal Kumar <[email protected]>
3 tasks
kkewwei
pushed a commit
to kkewwei/OpenSearch
that referenced
this pull request
Jul 24, 2024
* Bug/sbp cancellation (opensearch-project#13474) * change cancellation logic to fix disparity bw trackers and resource duress Signed-off-by: Kaushal Kumar <[email protected]> * add additional tests for searchBackpressureService and refactor code Signed-off-by: Kaushal Kumar <[email protected]> * add enumMap instead of list for tracking taskResourceUsageTrackets Signed-off-by: Kaushal Kumar <[email protected]> * add nodeNotInDuress test for nodeDuressTrackers class Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * add entry in CHANGELOG Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * remove wildcard import Signed-off-by: Kaushal Kumar <[email protected]> * streamline imports Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * add additional test case to test the circuit breaker for SBP logic Signed-off-by: Kaushal Kumar <[email protected]> * add missing javadoc to resourece type enum Signed-off-by: Kaushal Kumar <[email protected]> * add javadoc to a method Signed-off-by: Kaushal Kumar <[email protected]> * fix javadoc warnings Signed-off-by: Kaushal Kumar <[email protected]> * fix javadoc warnings Signed-off-by: Kaushal Kumar <[email protected]> --------- Signed-off-by: Kaushal Kumar <[email protected]> (cherry picked from commit bcccedb) Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> * Bug/sbp cancellation (opensearch-project#13474) * change cancellation logic to fix disparity bw trackers and resource duress Signed-off-by: Kaushal Kumar <[email protected]> * add additional tests for searchBackpressureService and refactor code Signed-off-by: Kaushal Kumar <[email protected]> * add enumMap instead of list for tracking taskResourceUsageTrackets Signed-off-by: Kaushal Kumar <[email protected]> * add nodeNotInDuress test for nodeDuressTrackers class Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * add entry in CHANGELOG Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * remove wildcard import Signed-off-by: Kaushal Kumar <[email protected]> * streamline imports Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * add additional test case to test the circuit breaker for SBP logic Signed-off-by: Kaushal Kumar <[email protected]> * add missing javadoc to resourece type enum Signed-off-by: Kaushal Kumar <[email protected]> * add javadoc to a method Signed-off-by: Kaushal Kumar <[email protected]> * fix javadoc warnings Signed-off-by: Kaushal Kumar <[email protected]> * fix javadoc warnings Signed-off-by: Kaushal Kumar <[email protected]> --------- Signed-off-by: Kaushal Kumar <[email protected]> * fix compilation error Signed-off-by: Kaushal Kumar <[email protected]> --------- Signed-off-by: Kaushal Kumar <[email protected]> Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Signed-off-by: kkewwei <[email protected]>
wdongyu
pushed a commit
to wdongyu/OpenSearch
that referenced
this pull request
Aug 22, 2024
* change cancellation logic to fix disparity bw trackers and resource duress Signed-off-by: Kaushal Kumar <[email protected]> * add additional tests for searchBackpressureService and refactor code Signed-off-by: Kaushal Kumar <[email protected]> * add enumMap instead of list for tracking taskResourceUsageTrackets Signed-off-by: Kaushal Kumar <[email protected]> * add nodeNotInDuress test for nodeDuressTrackers class Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * add entry in CHANGELOG Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * remove wildcard import Signed-off-by: Kaushal Kumar <[email protected]> * streamline imports Signed-off-by: Kaushal Kumar <[email protected]> * address comments Signed-off-by: Kaushal Kumar <[email protected]> * add additional test case to test the circuit breaker for SBP logic Signed-off-by: Kaushal Kumar <[email protected]> * add missing javadoc to resourece type enum Signed-off-by: Kaushal Kumar <[email protected]> * add javadoc to a method Signed-off-by: Kaushal Kumar <[email protected]> * fix javadoc warnings Signed-off-by: Kaushal Kumar <[email protected]> * fix javadoc warnings Signed-off-by: Kaushal Kumar <[email protected]> --------- Signed-off-by: Kaushal Kumar <[email protected]>
github-actions
bot
added
bug
This was referenced Sep 24, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
This PR is to address and fix the BUG: #13295
Changes
New Logic for Cancellation
Related Issues
Resolves #13295
Check List
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.